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(54) Modelling non-linear devices 

(57) A method ( 1 00, 1 00\ 1 00") utilizes time-domain 
measurements of a nonlinear device to produce or ex- 
tract a behavioral model from embeddings of these 
measurements. The resulting behavioral model of the 
nonlinear device is a black-box model that accommo- 
dates nonlinear devices with one or more input ports and 
one or more output ports. The black-box model is a func- 
tional fomi that is a closed fonn function of input varia- 
bles that produces an output as opposed to a structural 
fomn. The method (100, 100', 100") of producing a be- 
havioral model comprises the steps of applying (101, 
1 01 ') an input signal (204, 204") to the nonlinear device, 
sampling (1 02) the input signal (204, 204') to produce 
input data (21 0), measuring (103) a response of the de- 
vice to produce output data (21 2), creating (1 04) an em- 
bedded data set (213), fitting (105, 105') a function to 
the embedded data set (213), and verifying (106) the 
fitted function. The method (1 00, 1 00") may apply a CD- 
MA type input signal (204) in the step of applying (1 01 ), 
and/or the method (100', 100") may fit a novel radial ba- 
sis function in the step of fitting (105') a function. The 
input signal (204) is constmcted from a single CDMA 
signal representation. The method of constructing is not 
dependent on knowledge of the behavioral model of the 
nonlinear device. The radial basis function may be de- 
tentiined using a modified gaussian function. 
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D s ription 

[0001] The present invention relates to the d termination of behavioral models for nonlinear devices, circuits, sub- 
systems or systems. In particular the present invention is a method for creating excitation signals and a method for 
5 perfomning function fitting in the determination of behavioral models for nonlinear devices, circuits, subsystems, and 
systems from embeddings of time-domain measurements. More particularly it relates to excitation signal and radial 
basis function methods for use in extraction of nonlinear black-box behavioral models. 

[0002] Linear, time invariant (LTI) devices, circuits, subsystems, and systems are completely characterized by their 
transfer functions. To understand the performance of an LTI device, one need only determine the transfer function of 
10 the LTI device. Once the transfer function is known, the operation of the device in a system Is known completely for 
all input conditions. The same is true for LTI circuits, subsystems and systems. 

[0003] A transfer function is a complex frequency domain-function that describes the output of an LTI device in terms 
of its inputs and therefore, forms a complete description of the LTI device. The temn complex function when used herein 
refers to a function that includes complex numbers having a real and an imaginary part. An equivalent form of the 
IS transfer function of an LTI device in the time-domain is called an impulse response of the LTI device. A one-to-one 
relationship exists between the transfer function in the frequency-domain and impulse response in the time-domain. 
In addition, the transfer function and the impulse response are not functions of and do not depend on the Input signal 
that is applied to the LTI device. 

[0004] The detemnination of the transfer function, especially if it involves measured data from the LTI device, is known 

20 as model development or model parameter extraction. Once a model of an LTI device is developed, or equivalently 
the transfer function is known, for a given device, the actual device may be replaced by a virtual device based on the 
model in any simulation of a system using the device. Often the development of the model involves extraction or 
detemnination of model parameters from a set of test data that represents the device of interest. 
[0005] Transfer functions of LTI devices, circuits, subsystems, or systems can be extracted from measurements 

25 made with a vector spectrum or vector network analyzer. A swept or stepped frequency input signal is generated and 
the vector spectrum analyzer or network analyzer records the output of the LTI device. Then, a transfer function can 
be computed by comparing the Input and output signals. Furthermore, models suitable for simulation of a given LTI 
device or circuit can extracted from transfer functions using, among other things, linear system identification techniques. 
[0006] Time-domain measurements provide an alternate method of characterizing LTI devices or circuits. Pulse in- 

30 puts that approximate an impulse are applied to a device and the outputs are measured and recorded. In one such 
well known, time-domain method, the poles and zeros of the Laplace transform of the goveming differential equation 
of the device are estimatedfrom the recorded output data. Once a suitable governing differential equation is determined, 
the device transfer function is calculated. In an alternative method, the measured data associated with the impulse 
response is transformed using a Fast Fourier Transform (FFT) to the frequency-domain where a linear system identi- 

35 fication method is then used to extract the transfer function. 

[0007] The characterization or modeling of nonlinear devices or circuits is much more difficult than that for LTI devices. 
Reference to a "nonlinear device" when used herein will be understood to include devices, circuits, subsystems or 
systems with a nonlinear input-output relationship. Unlike the linear case, the nonlinear device or cinDuit is not readily 
represented by a transfer function or impulse response, at least not one that is independent of the input signal or 

40 stimulus. However, there is still a need to model nonlineardevteessothattheirperfonnanceinsystemscan be evaluated 
efficiently. This is especially true when it is impractical or too expensive to use the actual devbe, such as when the 
device is still being designed. 

[0008] It is desirable to have a method for characterizing and developing a model of nonlinear devices to avoid the 
need to have the actual device available whenever its perfomriance in a system must be investigated. Furthermore it 
45 Is advantageous to have such a modeling method utilize a finite set of measurements, either actual measurements or 
measurements of a simulation of the device. The model so generated must accurately predict the performance of the 
device over all expected operational conditions within a gh/en level of accuracy and with an acceptable amount of 
computational cost. 

[0009] The temn "behavioral model" herein refers to a set of parameters that define the input-output behavior of a 
50 device or circuit. Generally, a behavioral model must be of a form suitable for rapid simulation. "Simulated measur - 
ments" refers to values of voltage, current or other physical variables obtained from device, circuit or system simulation 
software. The objective of building a behavioral model from actual or simulated measurements is to reduce simulation 
time by replacing a complex circuit description in the simulation with a simpler, easier to simulate, behavioral model. 
[0010] Inmanycas s, nonlinear d vices are electronic in nature (e.g. transistors, died s). Inth secas sthem as- 
55 ur ments us d to produc a model of the d vie are typically measured voltages and curr nts In and out of the ports 
of the device or equivalently incident or reflected power waves present at the ports at various fr quenci s. The models 
extract d from the measurements generally n edt reflectthe dynamic relationships between the voltag sand curr nts 
at the ports. The model can be used, for example, to compute the currents Into the ports from recent values of the 
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voltages across the ports. Often this is the essential computation that must b provided to electronic circuit simulators 
by a software module that represents a device. 

[001 11 Mechanical and hydraulic devices can also exhibit nonlinear behavior and. therefore, be modeled as nonlinear 
devices for which construction of a suitable behavioral model would be beneficial. For example, a vehicular system 

5 comprising driver inputs and vehicle response may be represented in temis of a nonlinear behavioral model. In the 
case of vehicular systems, the input measurements might be of variables such as steering wheel position, brake pres- 
sure, throttle position, gear selection and the response measurements might be of variables such as the vehicle speed, 
lateral and longitudinal acceleration, and yaw rate. The behavioral model extracted from the measurements needs to 
reflect the dynamic relationship between the driver Inputs that are applied and the subsequent response of the vehicle. 

10 In other words, the model defines a 'Virtual car" that can be "driven" using previously recorded or real-time measured 
driver inputs. 

[001 2] A variety of methods have been developed to characterize and develop models of nonlinear devices. However, 
these methods generally have severe limitations associated with them. For instance, many of the techniques are limited 
to use with so called "weakly nonlinear devices", those devices whose performance is nearly linear. Therefore, these 

15 techniques are not suitable for many nonlinear devices. 

[0013] One such approach to characterization of weakly nonlinear devices is to simply assume that the device is 
linear, at least In the operational range of Interest. Under this assumption, a variant of the time-domain impulse response 
method described hereinabove can be used. For devices that are, in fact, weakly nonlinear devices, this approach 
yields reasonably good results. However, the accuracy of such a model will degrade rapidly as the amount or degree 

20 of n on linearity in the device increases. 

[0014] Another class of methods for characterizing nonlinear devices is represented by the Volterra input-output 
maps method (VIOMAPs) also known as the Volterra Series Method. VIOMAPs are models of nonlinear devices or 
circuits that can be extracted from frequency domain measurements such as those produced by using a vector spectrum 
analyzer. Here again, the usefulness of such models is limited by the assumption of weak nonlinearity. In addition, 

25 VIOMAPs and related methods can only model the steady state behavioral or response of the device. A steady-state 
response is the response of a device, linear or nonlinear, to a repeating input signal. An example of a steady-state 
response is the response to a sine wave input after sufficient time has passed to allow the transients associated with 
the application of the sine wave to decay. VIOMAPs and the related methods are powerful methods that have found 
many useful applications. However, VIOMAPs, as noted above, cannot handle strong nonlinearities or transient inputs. 

30 VIOMAPs are restricted to modeling the steady state behavior of devices that exhibit weak nonlinearities. 

[0015] Another, somewhat different, method of characterizing nonlinear devices is to use an equivalent circuit rep- 
resentation of the device of interest The approach in this method is to assume an equivalent circuit topology with a 
certain circuit parameter left free or unspecified that Is expected to adequately represent the device or circuit. For 
example, equivalent circuits are known that adequately represent certain classes of transistors (e.g. MOSFETs or 

35 BJTs). Given the assumed equivalent circuit, a set of measurements is performed on the device from whk^h the correct 
values of the free parameters can be computed or deduced for a particular device. 

[0016] As with the other methods, this approach for nonlinear device characterization has a number of serious dis- 
advantages. Chief among the disadvantages is the need for a pr/on knowledge of an equivalent circuit that adequately 
represents the device of interest. This often means that significant knowledge of the device is required before modeling 

40 can begin. If incorrect assumptions are made regarding the structure of the equivalent circuit, the method may not yield 
satisfactory results. Put another way, the approximation that is being made by choosing a particular equivalent circuit 
over another has an impact on accuracy that is hard to determine. In addition, this method is only useful when the 
device being modeled is of a type similar to electronic circuitry (e.g. a hydraulic device or spring-mass-dashpot system) 
that a representative equivalent circuit can be created. Finally, the equivalent circuit can require a significant amount 

45 of computer time to simulate, thereby often making this method unacceptably costly for use in the simulation of large 
systems. 

[0017] Therefore, It would be desirable to have a method for the construction of a behavioral model of a nonlinear 
device that is not limited to assuming the device Is weakly nonlinear and that does not require excessively large amounts 
of computational effort to produce simulated results. In addition, it would be desirable If this method were not limited 

so to steady-state response characterizations and this method did not require any a priori knowledge of the device being 
modeled. Moreover, it would be advantageous if this method would allow the model to be constructed from either actual 
measurements or simulated measurements of the device. Finally, it would be advantageous if this method utilized an 
excitation signal and employed a functional fitting technique that were broadly applicable to many nonlinear devices. 
Such a nonlinear charact rization and model construction m thod would ov rcom a long-standing problem in the 

55 area of nonlinear d vie modeling technology. 

[0018] The pr s nt inv ntion is based on the method for producing behavioral mod Is of nonlinear d vices that is 
described in co-p nding application serial no. 09/420,607, filed October 18, 1999. In partk:ular, the methods of the 
present invention are a method for producing behavioral models of nonlinear devices utilizing a robust excitation signal, 
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a method for producing behavioral models of nonlinear devices utilizing a novel radial basis function, a method for 
constructing the robust excitation signal, and a method of determining a novel radial basis function. The behavioral 
models resulting from the methods of the present invention accommodate nonlinear devices with one or more input 
ports and one or more output ports. 

5 [001 9] The methods of producing a behavioral model of a nonlinear device from embeddings of time-domain meas- 
urements of the present invention comprise the steps of applying an input signal to the nonlinear device, or equivalently 
to a virtual device, sampling the input signal to produce input data, measuring a response to the input signal at the 
output of the device to produce output data corresponding to the input data, creating an embedded data set using a 
first subset of the input data and a first subset of the output data, fitting a function to the embedded data set, and 

10 verifying the fitted function using a second subset of the input data and a second subset of the output data, wherein 
the verified fitted function is the behavioral model of the nonlinear device. In another embodiment, the fitted function 
can be used to compute a continuous-time model from the discrete behavioral model developed In the aforementioned 
steps. 

[O020] In one embodiment, the method producing a behavioral model of the present invention utilizes a code division 
IS multiple access signal (CDMA) as the input signal in the step of applying. In another embodiment, the method of 
producing a behavioral model of the present invention utilizes a novel radial basis function in the step of fitting a function 
to the embedded data set. In yet another embodiment, the method of producing a behavioral model utilizes both the 
CDMA type signal as an Input signal in the step of applying and the novel radial basis function In the step of fitting. 
[0021] Unlike the aforementioned conventional methods, the methods of the present invention are not restricted to 
^ modeling weakly nonlinear devices but can handle hard or strong noniinearities. The methods accommodate steady- 
state as well as dynamic noniinearities, requires no a pno/? assumptions regarding the device model structure and can 
handl devices with multiple, dependent Inputs. Further, the methods operate in the discrete time-domain with sampled 
measurements of input and output variables but are readily extended to a continuous representation of the device 
behavioral model. As such, the behavioral models produced by these methods are general in nature and are readily 
25 implementable representations of nonlinear devices including those exhibiting strong noniinearities. 

[0022] Moreover, the behavioral model created from the methods of the present invention can be used to simulate 
the output of the device, given input signals in the frequency-domain. The excitation signals utilized can be generated 
at reasonable cost at any frequency up to and beyond microwave frequencies. 

[0023] In another aspect of the present invention, a method of constructing an input or excitation signal for use In 
30 producing a behavioral model is also provided. The method of construction of the invention constructs a CDMA type 
excitation signal. The excitation signal so constructed is applied to a nonlinear device for behavioral model extraction 
from embedded time-series measurements according to the invention. 

[0024] The CDMA type signal is a single signal as opposed to multiple signals typical of the excitation signal con- 
structed according to the co-pending method. Advantageously, the single CDMA type signal of the present invention 
35 provides excellent phase space coverage. Therefore, use of the CDMA type signal in the methods of the present 
invention yields models with excellent agreement between the behavioral model produced thereby and the actual 
nonlinear device. 

[0025] In yet another aspect of the present invention, a method of determining a radial basis function for use in 
detennining a behavioral model is provided. The radial basis function comprises a novel modified gaussian function. 

^ When used In the production of a behavioral model in the methods of the present invention, the novel radial basis 
function of the present invention provides excellent agreement between the behavioral model and the nonlinear device 
being modeled. In addition, the radial basis function Is stable owing to the inherent partitioning of the modified gaussian 
function into two parts, one part associated with output data from the model and the other part associated with Input 
data from the excitation signal. 

45 [0026] In yet another aspect of the present Invention, the CDMA type excitation signal and the radial basis function 
of the present Invention can be used together in the method of producing a behavioral model of the present invention. 
[0027] The various features and advantages of the present Invention may be more readily understood with referenc 
to the following detailed description taken in conjunction with the accompanying drawings, where like reference nu- 
merals designate like structural elements, and in whteh: 

so [0028] Figure 1 illustrates a block diagram of the method of producing a behavioral model of the present Invention 
utilizing a CDMA type excitation signal. 

[0029] Figure 2 illustrates a block diagram of the method of producing a behavioral model of the present invention 
utilizing a radial basis function. 

[0030] Figure 3 illustrates a block diagram of th method of constructing an excitatton signal in accordance with th 
55 inventi n. 

[0031] Figure 4 illustrates a block diagram of the method of determining a radial basis functions in accordance with 
the invention. 

[0032] The methods of the present invention utilize time-domain measurements of a nonlinear device to produce or 
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extract a black box behavioral model of the device from embeddings of these measurements. The methods of th 
present invention are appllcabie to modeling devices where infomiation about the device is provided by either actual 

[0033] The use of embeddings to extract models from time domain measurements of nonlinear devices is called 
5 nonlinear time series analysis (NLTSA). The temi "black box" as used herein refers to a model that requires little or no 
detailed infomiation, such as the topology of an equivalent circuit, or knowledge of the underlying physics, of the device 
be known before the model is constructed. The terni "embedding" as used herein refers to a function or mapping from 
a set U to a new set IV, where U-^WIU QR^\WE R" and n>m, 

[0034] The methods of the present Invention are based on the method described In co-pending application serial no. 

10 09/420,607, filed October 1 8, 1 999. In one embodiment, the method of the present invention differs from the method 
of the co-pending application in that an input signal of the present invention is a specific type of CDMA signal having 
advantages in some instances to the input signals of the co-pending application, in another embodiment, the method 
of the present invention differs from the method of the co-pending application in thatthe method of the present invention 
incorporates a novel, radial basis function. 

15 [0035] A block diagram of one embodiment of the methods of the present invention is illustrated In Figure 1. In 
accordance with the invention, the method 1 00 of producing a behavioral model of a nonlinear device from embeddings 
of time-domain measurements is an iterative process and comprises the step of applying 101 an input signal 204 to 
the nonlinear device. The input signal 204, u(t), of the method 100 of the present invention, also referred to herein as 
an excitation signal 204, is a code division multiple access (CDMA) type signal given by 

20 



u{i) = Acos{2nf j)'^b,{t)p, (1) 



wherein the coefficient A is a constant amplitude value used to scale u(t}, the input signal 204, is a carrier frequency 
of the CDMA type input signal 204, b^f), where /= 1 -» N, are A/-dimensional random vectors sequenced on t Preferably, 
b/0 is a binary random vector or sequence, sequentially taking on values of -1 or + 1 as t is indexed. The variable 'f 
30 as used herein refers to an independent variable generally associated with time. The coefficients Pf are the coeffbients 
of a finite Impulse response (FIR) filter. The preferred embodiment of the FIR filter provides an Input signal 204 with a 
flat spectrum and with a fixed bandwidth about a given center frequency. 

[0036] As in the method of the co-pending application, the input signal 204 of the method 1 00 of the present invention 
is constructed such that it covers a large portion of the "phase space" of the non-linear device to insure thatthe device 

35 is adequately excited for accurate model production. The temn "phase space" as used herein refers to the collection 
of possible states of a dynamical system. A phase space can be finite, countably infinite, or uncountably infinite in 
dimension. For example, the phase space of an ideal coin toss experiment has a dimension of two (I.e. "heads" or 
"tails"). In the co-pending application, the requirement for adequate phase space coverage was met by perfomiing a 
series of "experiments" involving the sequential application of a number of carefully selected single-tone signals to the 

40 nonlinear device. The selection of these single-tone signals Is such that after numerous experiments, the phase space 
of the device was covered adequately and an accurate model was produced. However, in the present method 1 00, the 
phase space coverage is provided by a single Input signal 204 in a single experiment. Additionally, in both the co- 
pending method and the method 1 00 of the present invention it is a desirable feature of the input signal 204 that it can 
be generated economically or, in other words, the input signal 204 should be relatively easy to produce. 

45 [0037] The Input signal 204 as given by equation (1), even though known In the art as useful for spread spectrum 
communications, advantageously and unexpectedly provides excellent phase space coverage for most nonlinear de- 
vices when used in the method 1 00. Therefore, the input signal 204 as given by equation (1) Is an excellent Input signal 
for producing a behavioral model of a nonlinear device from embeddings of time-domain measurements according to 
the present invention. In addition, the input signal 204 of equation (1) is relatively simple to generate and, unlike the 

50 method of the co-pending application, does not require multiple experiments to be periormed. Construction of the input 
signal 204 given by equation (1) is described in more detail hereinbelow. 

[0038] The method 1 00 further comprises the step of sampling 1 02 the input signal 204 to produce input data 210. 
The input signal 204 is sampled at discrete time intervals during the step of applying 101 . The time intervals can be 
fix d or variabi and generally depend on th input signal 204 characteristics. Sampling 102 may b eith r actual 
55 sampling of th input signal 204, as it is applied to th devic , or virtual sampling, wher In th sampi s ar created 
directly from a mathematical d scription of the input signal 204. In the pref rred mbodiment, th tim intervals are 
fix d according to standard ngineering practice and the input data 210 is stored as an array f values in a computer 
memory. 
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[0039] The method 100 further comprises the step of measuring 103 an output signal or a r sponse signal 206 to 
the input signal 204 at an output port of the device to produce output data 212 corresponding to the input data 210. 
The response is m asured at discrete time intervals and the output data 212 represents a time-series of the response 
signal. In the preferred embodiment, the response signal 206 is measured at the same discrete time intervals and 
times as is used for sampling 1 02 the input signal 204 and the output data 212 is stored as a separate array or set of 
values In a computer memory. 

[0040] The step of measuring 103 may be followed by a step of filtering 103a the output data 212 in a preferred 
embodiment of the method 1 00. The step of filtering 103a is used to reduce the noise content of the output data 212. 
Noise is a corruption of the data that may be introduced during the step of measuring 103 and is well known to one 
skilled in the art. The step of filtering 103a may be accomplished using either linear or nonlinear filtering techniques. 
Preferably, the data 21 2 is filtered using one of several nonlinear filtering techniques known in the art and described 
further in the co-pending application. Nonlinear filtering techniques have the advantage of preserving the nonlinear 
response characteristics of the device present in the output data 212. Moreover, where the Input data 210 is sampled 
directly from the input signal 204, the input data 210 may also be filtered using well known techniques. 
[0041] The method 1 00 still further comprises the step of creating 1 04 an embedded data set 21 3 using a first subset 
21 Oa of the input data and a first subset 21 2a of the output data. The step of creating 1 04 an embedded data set 21 3 
comprises the steps of determining 1 04a an embedding type and dimension and then embedding 1 04b the first subsets 
21 Oa, 21 2a in an embedding space defined in the step of determining 1 04a. Applicable embedding types of the present 
invention include, but are not limited to, so called "lagged" embeddings, embeddings using singular value decompo- 
sition (SVD) of the data, wavelet embeddings and combinations thereof. The embedding types differ by the specific 
lineariy independent functions that are used, as is described further hereinbelow. However, in general terms, the em- 
bedding type can be represented by a set of functions E as given by 



25 
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^liPi^ -T ),. . - ),u{t ),. . . , w(r - mx )), 
e« {y{^ - T ),..., y(r ^ /x ), fi(r - x ),..., ii(f - mx )) 



where elements of the set, e^, are functions of the input and output data sets and where /, m, and x are dependent on 
35 the specific embedding type and related to the embedding dimension. An example of a function from an embedding 
E is a first order approximation of a derivative of the output variable y(0 given by 



40 



ei (y(f - t),....y(f - h), u(t - T),..., u{t-nn)) 



y(t'2x)-y{t-%) 



Another example of an applicable embedding function e„ is the Haar wavelet of length 4 operating on y (Q given by 



45 



y(t-x) y(t-h)Mt-x) u{t- mx)) = 

y( t - 4T)+y( t - 3T)-y( f - 2t) - y( f - x) 

The subscripts in these examples are arbitrary. A so-called "pure" lag embedding would be given by 



so 



55 



^\ {y{^ - T ),..., ^ /X ),«(/ -T ),..., 5(r - WIT )) = y{t -X )/ 

^2 {y{^ -''^ V • • >y{^ - % u{t -X ),. . . - /Tlx )) = y{t - 2x ), 

{y{f V . . - ),!/(/ -X V . . ,5(r - /77X )) = W(/ ~ WX ) 
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where k = l+ m. Ther fore, it would be evident to one skilled in the art that a set of functions of the input and output 
data can be chosen. 

[UU42j Delermiiiiny 'lOna m£ emDeGGing d;r::u::s:v::. it: InV-:-™" r.hr.-^lr.g thc r/Jrr.bor Cf lif^.e'^'^y 'nHonAnriftnt 
functions to be used. The combination of the embedding dimension and the embedding type or functions defines the 

5 embedding space. Along with determining 104a an embedding type, detennining the embedding dimension is often 
accomplished In practice in an iterative process. In the step of embedding 1 04b, the first subset 21 Oa of the input data 
and the first subset 212a of the output data are "embedded" in the embedding space defined and dimensioned in step 
1 04a. The step of embedding 1 04b transfomis the first subset 21 Oa of the input data and the first subset 21 2a of the 
output data into a first embedded data set 213a. In general, the amount of data contained in the first embedded data 

10 set 213a is larger than that in the original first subsets 210a, 212a. 

[0043] The first subset 210a of input data and the first subset 212a of output data contain less data than the total 
data produced for each according to a prefen-ed embodiment of the method 1 00. The remaining portions of the input 
data 210 and the output data 212 not included in the first subsets are used in a verification step 106 described below 
and are referred to as a second subset 210b of Input data and a second subset 21 2b of output data, respectively. In 

IS another embodiment thereof, the first subsets 21 Oa', 21 2a' comprise all of the available data and therefore, additional 
data are generated for the second subsets 21 Ob', 21 2b' after the step of creating 1 04 the embedded data set 21 3 for 
use in the verification step 1 06. The step of creating 1 04 the embedded data set 2 1 3 , in particular the step of detennining 
104a the embedding type and the embedding dimension, is described further in the co-pending application. 
[0044] The method 1 00 further comprises the step of fitting 105 a function G(*) from embedded data set 213 to the 

20 corresponding output data 212. In general, the function G(0 Is a function of the embedded data set 213 created in the 
step of embedding. 
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K/ + 1) = G 



where y(0 is the first subset 212a of the output data at time f, 15(0 is the first subset 21 Oa of the input data at time f, / 
is the number of lagged data samples talcen from the first output data subset 212a, m Is the number of lagged data 
35 samples taken from the first input data subset 210a and t is a multiple of a time between samples At {v= kMj, also 
called a "lag". The sample interval or sample time Af corresponds to the above described discrete time interval used 
in the sampling step 1 02 and the measuring step 1 03. In the specific case of a lag embedding, the function G{ ) is of 
the fonri 

y(f + 1) = G(y(0.y(f- 1 )„.., y{t- /t), u(t-x) S(f - nn) 

A corresponding fomn of G( ) for other embedding types would be readily apparent to one skilled in the art. 

[0045] The step of fitting 105 comprises the steps of detennining 105a the function G( ), and selecting 105b the 

45 structural parameters (t, /and m in the fagged embedding case] and/or other parameters of function G(*)- For example, 
other parameters may include polynomial coeff toients in the case of a polynomial town of the function G( ). The step 
of fitting 105 is often called model estimation or training and is well known to those skilled in the art. Likewise, when 
other embeddings are used, one skilled in the art would readily recognize an alternative fomn those hereinabove that 
would be applicable in addition to the structural parameters involved. 

50 [0046] There are a number of techniques for perfomiing the step of fitting 1 05 that are generally applicable to a wide 
variety of embedding types. The techniques include, but are not limited to: (1) least-squares fitting with multivariate 
polynomials, (ii) fitting using other appropriate basis functions, such as radial basis functions, (ill) fitting using a neural 
network as a universal function approximator, (iv) fitting with local linear models, and (v) fitting with cluster-weighted 
models. In addition, there ar many oth r techniques for fitting a function to data that may b used with the pr s nt 

55 Invention. Th r may be advantages of using on of thes methods ov r the oth rs in specific practical situations. 
Such advantag s and the correct choice of the function fitting method given a particular embedding should be obvious 
to one skill d in the art and are all within the scope of the present invention. 

[0047] The method 1 00 further comprises the step of verifying 1 06 the fitted function G(-) using the second subset 
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21 Ob, 21 2b of the input data and the output data. The step of verifying 1 06 comprises the step of using 1 06a the second 
subset 21 Ob of Input data to produce a second embedded data set 213b. The step of verifying 1 06 further comprises 
the step of using 1 06b the first embedded data set 21 3a and the second embedded data set 21 3b in the fitted function 
G(-) to produce a first predicted data and a second predicted data, respectively. The step of verifying 106 further 

5 comprises the step of comparing 1 06c the second predicted data from the function G(-) to the second subset 212b of 
output data. The objective of the step of comparing 1 06c is to determine If the predicted data Is sufficiently similar to 
the second subset 212b of the output data from the device. Whether the predicted data and the second subset 212b 
of the output data are sufficiently similar wiil depend on the particular application and should be apparent to one slcilled 
In the art. If the second predicted data and the second subset 212b of the output data are sufficiently similar then the 

10 fitted function G( ) accurately mimics or is said to accurately model or predict the performance of the device. The 
verified fitted function G(-) then becomes the behavioral model of the nonlinear device in a discrete time representation. 
[0048] In general, the definition of "sufficiently similar" will depend on the specific application of the present invention. 
However, two tests are typically perfonned to help verify 106 the fit of the function G(-). The first test assesses the 
absolute error between the second predicted data produced by the fitted function G(-) and measured data that makes 

15 up the second subset of output data 21 2b. The second test assesses whether the function G(-) fits well to both the first 
and second embedded data sets (213a, 213b) with respect to the corresponding first and second subsets of the output 
data (212a, 212b). Both of these tests are described in detail in the co-pending application. 

[0049] In another embodiment of the method 1 00, the step of verifying 1 06 further comprises the step of converting 
106d the behavioral model from a discrete time representation to a continuous time representation. Converting from 

20 a discrete time representation to a continuous time representation is well known to those skilled in the art. 

[0050] In the method 100 of the present invention, the step of applying 1 01 the excitation signal 204 to a device is 
followed by the step of sampling 1 02 the input signal 204 to produce input data 21 0 and the step of measuring 1 03 the 
response of the device to the excitation signal 204 to produce output data 212. Preferably, the steps of sampling 102 
and measuring 103 are performed at discrete time intervals. It is well known by those skilled in the art that typical 

25 measurements for electronic devices include electrical values such as voltages, currents, incident and reflected power 
waves at various frequencies. Typical measurements for mechanical or hydraulic devices including but not limited to 
the motorized vehicle example, are temperature, pressure, volumes, positions, speeds, and accelerations. For exam- 
ple, measurements taken on the vehk^le might comprise driver inputs such as steering wheel position, brake pressure, 
throttle position, gear selection and the response of the vehicle including speed, lateral and longitudinal acceleration, 

30 and yaw rate. In the preferred embodiment of the present invention, the input signal 204 to and the response or output 
signal 206 of, the device are sampled 1 02 and measured 1 03 by sampling and digitizing with an appropriate sample 
rate or sample interval At. One skilled in the art would recognize that there are many approaches to sampling an input 
signal 204 and measuring an output signal 206 of a device and without undue experimentation would be able to choose 
an appropriate system for a given device or class of devices. 

35 [0051] Further, in accordance with the invention, the step of creating 104 a first embedded data set 213a involves 
operations that transform the first subset 21 Oa of input data and the first subset 21 2a of output data into a new, usually 
expanded, first embedded data set 213a by applying selected, linearly independent functions to the first input data 
subset 210a and/or the first output data subset 212a. In the preferred embodiment, the linearly independent functions 
defined by a choice of the embedding type are either lags of the input and output data (210, 212) or combinations of 

40 lags and wavelets. 

[0052] In another embodiment, the method 1 00' of producing a behavioral model of the present invention comprises 
the step of sampling 1 02, the step of measuring 1 03 the output signal 206, the step of creating 1 04 an embedded data 
set 213 a function to the embedded data 213, and the step of verifying 106 the fitted function as described above for 
the method 100. However, in the method 100', the step of applying 101' and input signal 204' and the step of fitting 
45 1 05* a function to the embedded data 21 3 differ from the method 1 00 as described below. 

[0053] A block diagram of the method 1 00' is illustrated in Figure 2. In the method 1 00' the step of fitting 1 05' utilizes 
a function G{*) of the form 

so y(f+1)=G(z(f)) 
where 
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Moreover, in the method 1 00' of the present invention, the step of fitting 1 05' involves finding coefficients of a specific 
fonn of the function known as a radial basis function given by 



wherein the coefficients p, a, % are constant paranfieters to be estimated or detenmined during the step of fitting 1 05'. 
The coefficients C/ are known as centers and are also detenmined during the step of fitting 1 05'. The centers are es- 
sentially localization functions. The centers can be chosen arbitrarily or using iterative techniques such as least- 
squares. The preferred methods for selecting the centers C/are the "subset selection methods" of K. Judd and A. Mees, 
"On selecting models for nonlinear time series," Physics 82D, 1995, pp. 426-444 incorporated herein by reference. 
These subset selection methods find a subset of centers from a candidate set chosen arbitrarily that best describes 
the data. 

[0054] The function <|>(-) within the radial basis function of equation (2) is a novel modified gaussian function and is 
given by 



wherein x represents the part of z reconstructed using prior output values, and u represents the parts of zconstructed 
from the input signal 204'. The coefficients c is the "output" center associated with and having the same dimension as 
X and similarly the coefficient d is the "input" center associated with and having the same dimension as u. The temris 
vand IV are the fixed-widths of "outpuf and "input" gaussian functions of equation (3). In the preferred embodiment 
of the method 1 00' of the present invention, the tenns v and w are calculated from the standard deviations of the output 
and input data respectively. 

[0055] Advantageously, the use of the novel basis function given in equation (2) with equation (3) produce behavioral 
models whose predicted output converges to a constant output value for conditions when the input signal 204' is zero 
((y= 0). This result is achieved by the novel partitioning of equation (3) produces behavioral models that are stable in 
the presence of a zero stimulus condition. 

[0056] Furthenr^ore, in the method 100', the input signal 204' of the step of applying 101* can be any time-domain 
signal that provides adequate phase space coverage including the input signal 204, described above, and the Input 
signals of the co-pending application. 

[0057] In yet another embodiment, the method 1 00" of producing a behavioral model of the present invention com- 
prises the step of applying 1 01 an input signal 204, the step of sampling 1 02 the input signal 204, the step of measuring 
1 03 the output signal 206, the step of creating 1 04 an embedded data set 21 3, the step of fitting 1 05' a function to the 
embedded data 21 3, and the step of verifying 1 06 the fitted function. Method 1 00" differs from method 1 00 and method 
100' in that the step of applying 101 utilizes the CDMA type signal 204 of equation (1) of method 100 and the step of 
fitting 105' utilizes the novel radial basis function given by equation (2) in conjunction with equation (3) of method 100'. 
[0058] In another aspect of the invention, a method 300 of constructing a CDMA type input or excitation signal 204 
for use in the step of applying 101 of the methods 1 00, 100" of the present inv ntion is provided. Th method 300 of 
constructing is illustrated in Figur 3. The method of constructing 300 a CDMA type Input signal 204 giv n by equation 
( 1 ) comprises the step of s lecting 302 a carri r f requ ncy The carrier frequency is preferably selected 302 based 
on an xpected or desired op rational range in which the nonlinear device is to be perated. For example, if an amplifier 
intend d for cellular base station applicatbns is being modeled, then the carrier frequency can be selected 302 to 
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correspond to the center of the cellular telephone frequency bands. One skilled in the art would be readily able to select 
302 a suitable carrier frequency f^for a given example without undue experimentation. 

[0059] The method of constructing 300 further comprises the step of choosing 304 a vector dimension A^. The vector 
dimension N is an arbitrary integer but is generally chosen 304 to be an integer greater than forty. Preferably, N is an 

5 integer in the range between forty-five and sixty. 

[0060] The method of constructing 300 still further comprises the step of generating 306 the random vectors 
Preferably the random vectors d/are uniformly distributed binary psuedo-random noise (PN) sequences comprised of 
sequences of 1 's and O's. A unifomily distributed PN sequence and methods for generating 306 a uniformly distributed 
PN sequence are well known to those skilled in the art. 

10 [0061] The method of constructing 300 still further comprises the step of computing 308 the bandpass filter coeffj> 
cients Pf, As noted above, the bandpass filter coefficients are preferably those of a finite impulse response fitter (FIR) 
that provides an input signal 204 with a flat spectrum and with a fixed bandwidth about a given center frequency. The 
step of computing 308 a suitable set of filter coefficients p/ can be accomplished with techniques that are well known 
in the art. For example, a suitable FIR bandpass filter design is the one used for the industry standard IS-96 CDMA 

15 pulse shaping application and is described in detail in J. S. Lee and L. E. Miller, CDMA Systems Engineering Handbook, 
Artech House, Boston, 1998, pp. 58-64. 

[0062] The method of constructing 300 still further comprises the step of picking 310 a constant amplitude value A 
and the step of calculating 312 the input signal 204 using equation (1 ). The step of picking 310 the constant amplitude 
value A depends on the characteristics of the nonlinear device being modeled. Generally A is picked 31 0 to adjust the 

20 peak and average values of the input signal to be within a range of acceptable operation for the nonlinear device being 
modeled. One skilled in the art would readily be able to pick 310 a suitable value for A for a given nonlinear device. 
The step of calculating 312 the input signal 204, u(t) of equation (1), or the input signal 204 comprises the steps of 
inserting the values of the coefficients and PN sequences detemnined in step 302-310 into equation (1 ) and indexing 
the equation (1) on the variable t. 

25 [0063] In yet another aspect of the invention , a method 400 of determining a radial basis function given by equations 
(2) and (3) for use in the step of fitting 105' of the methods 100', 100" of the present invention is provided. A block 
diagram of the method 400 of the present invention is illustrated in Figure 4. The radial basis function is defined by 
equation (2). In the preferred embodiment of method 400, the radial basis function of equation (2) utilizes the modified 
gaussian function given by equation (3). 

30 [0064] Accordingly, the method 400 comprises the step of detemnining 402 the output center c and the input center 
d. The centers c and dean be determined arbitrarily or through any of several techniques including least-squares, a 
method known in the art. The preferred techniques of detemiining 402 the set of output centers c and the input centers 
d is that described by Judd and Mees, referenced above. 

[0065] The method 400 further comprises the step of calculating 404 the output widths v and the input widths iv. In 
35 the preferred embodiment of the method 400, the coeffk^ient v is equal to the standard deviation of the first subset of 
the input data 21 Oa and the coefficient w is equal to the standard deviation of the first subset of the output data 21 2a. 
[0066] The method 400 still further comprises the step of finding 406 the basis function. The centers and the coef- 
ficients detemnined in steps 402 and 404 are inserted into the modified gaussian function of equation (3). The modified 
gaussian function of equation (3) is then used in equation (2) during the step of fitting 1 05' wherein the parameters p, 
40 a, and co, are iteratively detennined. 

[0067] Thus there has been disclosed new and non-obvious methods for the extraction of a behavioral model of a 
nonlinear device from embeddings of time-series of sampled and measured input and output signals utilizing CDMA 
type input signals and/or a novel radial basis function. Moreover, a method of determining a novel radial basis function 
and a method of constructing a CDMA type input signal have been disclosed. Changes and modifications may be made 
45 to the invention that may be readily apparent to those skilled in the art without going beyond the Intended scope of the 
invention, as defined by the appended claims. 



50 



Claims 



1. A method (100', 100") of producing a behavioral model of a nonlinear device from embeddings of time-domain 
measurements, the device being real or virtual having one or more input ports and one or more output ports* the 
method {100*, 100*") having the steps of applying (101, 10V) an input signal (204, 204*) to the input port of the 
nonlinear device, sampling the input signal (204, 204') to produce Input data (210), measuring (103) a response 
55 to th input signal (204, 204*) at the output port of the d vice to produce output data (212) corresponding to the 

input data (210), creating (104) an emb dded data set (213) using a first subset (210a) of th input data and a 
first subset (21 2a) of the output data, fitting (1 05') a function to th embedded data set (21 3), and verifying (1 06) 
the fitted function using a second subset (210b) of the input data and a second subset (212b) of the output data, 
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20 



25 



30 



such that the v rifled fitted function is the behavioral model of the nonlinear device, wherein the step of fitting (1 05') 
a function comprises using a radial basis function given by 



>'(/+l) = p+a.r(/) + |;a),4.(||c,-2{/|) 



10 wherein p, a, and are coefficients that are detemnined during the step of fitting, z(0 is output data, and c,- are 
centers of the radial basis function and wherein <{)(•) is a function of the centers q and the output data z(0. 

2. The method (100\ 1 00") of Claim 1 wherein the function ^{ ) is a modified gaussian function given by 



\C'Z\\\^e^^ 



e 



wherein x represents a part of z reconstructed using prior output values, u represent the parts of z constructed 
from the input signal, the coefficient c is an output center associated with and having a same dimension as x, the 
coefficient d is an input center associated with and having a same dimension as u, and the terms v and w are 
fixed-widths of output and input gaussian functions, respectively. 

3. The method (1 00") of Claim 1 or 2 wherein the step of applying (1 01) an input signal (204) comprises: 
the step of constructing a CDMA type signal 1/(0 given by 



u{()^AcQs{2nf,t)Y,b,(t)p, 



35 wherein is a center frequency, b/it) are randonri vectors, p, are coefficients of a bandpass finite impulse 

response (FIR) filter, N is a vector dimension expressed as an integer, and >4 is a constant amplitude value. 

4. The method (1 00") of Claim 3 wherein the step of constructing a CDMA type signal u(t) comprises the steps of: 
40 selecting (302) the carrier frequency f^; 

choosing (304) the vector dimension N; 
generating (306) the random vectors bf, 

45 

computing (306) the filter coefficients 
picking (310) the constant amplitude value A\ and 
so calculating (312) the input signal u((). 

5. The method (1 00") of Claim 3 or4 wherein the random vectors d/(Q are unrfomnly distributed binary random vectors 
of I's and O's. 

55 6. Th method (1 00") of Claim 3, 4 or 5 wherein a c nter f r qu ncy Is a center frequ ncy of an operational range 
of the nonlinear device. 
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sampling (102) the input signal (204, 204') to produce 
input data (210), measuring (1 03) a response of the de- 
vice to produce output data (21 2), creating (1 04) an em- 
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the embedded data set (213), and verifying (106) the 
fitted function. The method (1 00, 1 00") may apply a CD- 
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nonlinear devic . Th radial basis function may be de- 
tentiined using a modlfi d gaussian function. 



100 



101 



102 



103 



Apply CDMA 
type Inptbt 
SigTuU 204 



Sample Input 
Signal 204 



I 

C->L J^easixre Output 
Signal 206 



— ^ 103a 

i mt^ ^"1 

j Oztiput Data 212 



I 



(optional) 



1 0A- 



Create an Embedded 
^ Data Set 213 



106 



foe 



"^Fit a Function 
to the Embedded 
Data 213 



FIG, 1 



Verify 
Fitted Function 



Printed by Jouve, 75001 PARIS (FR) 



BNSDOCID: <EP 112B293A3_L> 



EP1 128 293 A3 



European Patent 
Office 



EUROPEAN SEARCH REPORT 



Apptteation Number 

EP 01 30 1681 



DOCUMENTS CONSIDERED TO BE RELEVANT 



Category 



Citation of document wfth incUcailon, where appropriate, 
of relevant passapes 



Relevant 
to claim 



CLASSinCATfON OF THE 
APPLICA-nOW (inLCI.7> 



WALKER D N EI AL: "Constructing 

transportable behavioural models for 

nonlinear electronic devices" 

PHYSICS LETTERS A, 17 MAY 1999, ELSEVIER, 

NETHERLANDS, 

vol. 255, no. 4-6, pages 236-242, 
XPOOl 100673 
ISSN: 0375-9601 

* the whole document * 

GARD K 6 ET AL: "Characterization of 

spectral regrowth in microwave amplifiers 

based on the nonlinear transformation of a 

complex Gaussian process** 

IEEE TRANSACTIONS ON MICROUAVE THEORY AND 

TECHNIQUES, JULY 1999, IEEE, USA, 

vol. 47, no. 7, pt.l, pages 1059-1069, 

XP002214914 

ISSN: 0018-9480 

* abstract * 

US 5 946 482 A (TROYANOVSKY BORIS ET AL) 
31 August 1999 (1999-08-31) 

* column 3, line 47 - column 4, line 29 * 

PEDDANARAPPAGARI K V ET AL: "Vol terra 
series transfer function of single-mode 
fibers" 

JOURNAL OF LIGHTWAVE TECHNOLOGY, DEC. 
1997, IEEE. USA, 

vol. 15, no. 12, pages 2232-2241, 

XP002214915 

ISSN: 0733-8724 



1,2 



G06F17/50 



3-6 



1-3 



TECHNICAL FIEU3S 
SEARCHED <lntCU7} 



G06F 



The present search report has been drawn up for an etalrns 



THE HAGUE 



Dale cf ooraptolion of the Gawioh 

26 September 2002 



Examiner 

Guingale, A 



CATEGORY OF CITED OOCUMEI^S 

X : particutefly velovant tt taken alone 

Y : partkuitarty relevant if cxinnbined wttti another 

document of the same category 
A : technologiCBl badsground 
O: nofi - wm ea dtadosure 
P : imermedlaia dscument 



T : theoiv or prtnc^ urMlerlylng the {nvetrikui 
E : Barter patent document, but putofehed on. or 

allartttefWnodalA 
D : dooumerrt ctod in the applkation 
L : document dtad tor other naasons 



& : member of ttis g 
document 



9 patent lamHy, conesponding 



BNSOOCID: <EP 1 126293A3J 



EP1 128 293 A3 



1^ 

0 



cisropean raiein 
Office 



EUROPEAN SEARCH REPORT 



EP 01 30 1681 



DOCUMENTS CONSIDERED TO BE RELEVANT 



Category 



Citation of document with indication, where appropriate, 
oir 



Relevant 
todaim 



CLASSIFICATION OF THE 
AW.CAT10N <lntCI.7) 



WALKER D H ET AL: "Phase space 
reconstruction using input-output time 
series data" 

PHYSICAL REVIEW E (STATISTICAL PHYSICS, 

PLASMAS, FLUIDS. AND RELATED 

INTERDISCIPLINARY TOPICS), OCT. 1999, APS 

THROUGH AIP, USA, 

vol. 60. no. 4, pages 4008-4013, 

XP002214916 

ISSN: 1063-651X 



TECHNICAL FIELDS 
SEARCHED (lnta.7) 



The present aearch report has been drawn up for all claims 



THE HAGUE 



OBtA ol OOnviflliVI d tifr BOSftfl 

26 September 2002 



Gulngale, A 



CATEQORY OF CfTED IXXXJUENTS 

X : pajllcutarly movant tr talcen atone 

Y : paittcularty ffolavarri if comMnadMflh anolher 

documont of the same category 
A : technologtcai bado^ound 



T ! theory or prmdpleuMleflyfng ttie Invention 
E : earlier patent documerU, but piitHslied on, or 

anerttietlingdaie 
D : documan! cted in the applcation 
L : documert ded for other reasons 



P : intennedlsle document 



a : member of the s 
documert 



9 patent family, oorreapondng 



BNSDOCI[>. <EP 112a29aA3J_> 



EP 1 128 293 A3 



ANNEX TO THE EUROPEAN SEARCH REPORT 
ON EUROPEAN PATENT APPLICATION NO. 



EP 01 30 1681 



This annex lists the patent family membersrelating to the patent documents cited in the atiove-mentloned European search report. 
The mamliers are as oonMned in the European Patent OfHee E DP fie on 

The European Patent Office is In iiovyayllaUe tor these particularewhicti are merelyglven torthe puipoeeof tnformation. 

26-09-2002 



Patent document 
cited in search report 



Pubfication 



Patent family 
niefnber(8) 



Publication 



US 5946482 



31-08-1999 NONE 



i For more details about this annex : see OffidaUoumal of the European Patent Offloe. No. ^2J82 



BNSDCX:iD: <EP 1 128293A3_L> 



